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Abstract. We give a simple and elementary proof of the identity 



(N 



r=l fci,...,fc r >l:£[ =1 fe i=™ 



where n G N. A first application of this formula shows Cayley's theorem [2] on the 
, number of trees with n + 1 vertices (in fact the formula is equivalent to Cayley's 

result). A second application gives the distribution of avalanche sizes, which can 
be deduced for general dynamical systems and also as a bilogically motivated urn 
' model in probability. In particular, the law of avalanche sizes in Eurich et al. [I] 

£^ , and Levina [5] is closely related to this dynamical representation. 

1. Introduction 

The purpose of this note is to introduce avalanche dynamics into the theory of 
dynamical systems. This is a type of inducing scheme which defines new dynamical 
systems leaving the orbit structure mostly untouched. Such inducing schemes are 
first of all known as inducing on a set: let (X, T) be a dynamical system (discrete 
time) and A G X, then the transformation induced by A is defined by 

T A (x) = T^ x \x) 

where <p(x) = inf{n > 1 : T n (x) G A}. This defines a transformation on all points in 
A which return to A infinitely often. Next we mention Schweiger's jump transforma- 
tion (see p]) which is defined by 



T* A (x) = T^ x \x) 

where ip(x) = 1 for x G" A and ip(x) = inf{n > 1 : T n (x) A} for x G A. Variants of 
this are also known, like Young tower constructions (see [T2]). 

Avalanche dynamics is another inducing scheme and will be defined in Section 3. 
The new orbits will be a subset of the old orbits leaving the order structure invariant. 
This definition is motivated by the study of avalanches in neural dynamics (see eg 

i)- 

We begin with a short and rough description of the physiological background of 
neuronal dynamics. There are two types of cells in the central nervous system, one 
of them is called neuron, which communicate by sending and receiving electrical im- 
pulses. The cell membrane has built into it channels and ion pumps, letting potassium 
ions rushing out, and sodium ions flushing in. This process of exchange of potassium 
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and sodium ions (once initiated) stops after a few milliseconds when repolarisation is 
achieved. The process needs an external activation for getting started. 

The integrate and fire model goes back to Lapique in 1907 (0). It describes the 
time series of the potential of the cell membrane. It can be written as an ordinary 
differential equation of the form 

C m ^- = 9i{V res -V(t)) + I(t), 

where C m is called the capacitance of the cell membrane, V(t) is the voltage (poten- 
tial) at time t, V res is the residual potential, gi is the leak conductivity of the cell 
membrane and I(t) is the current at time t. This time evolution of the potential of a 
neuron is interrupted if the potential reaches a certain threshold value (this is when 
the process of exchange of potassium and sodium ions starts). At this point it gives 
a fixed electrical impulse to each of its neighboring neurons. Thus other neurons' 
potential may reach the threshold, thus initiating an avalanche of firing neurons. We 
are concerned in Section 3 with the size of this avalanche. If the dynamics of the 
neurons is stationary, we derive an asymptotic expression for the probability of the 
avalanche size. Such expression had been found earlier by Eurich et al ([4]) and 
Levina ([5J). Our expression is slightly more general and includes the earlier results 
as conditional distributions given that one neuron is excited. Furthermore, we also 
study this distribution in more detail. 

The key observation to our approach is a combinatorial formula which we prove in 
Section 2. Although this formula does not seem to be discussed in the literature, it can 
be deduced from Cayley's result on the number of labeled trees (0); it also is a special 
case of Corollary 8 in [IT] . In fact we show that the formula also implies Cayley's 
result, thus adding a new proof of Cayley's formula. In view the combinatorial formula 
and the two applications, we suspect that there is a connection between avalanche 
sizes and branching processes in the critical case (avalanche sizes are calculated by one 
side in the formula, while the total number of successors in a branching process are 
calculated from a rooted tree, which is represented by the other side of the formula). 
In fact, Levina has derived such a relation showing that the asymptotic distributions 
are the same. This leads to a power law of the distribution using a result by Otter 
([8]). Such a power law is also derived in Section 3. 

Acknowledgement: We would like to thank Ira Gessel and Wlodek Bryc for some 
helpful remarks. 

2. A Combinatorial Formula 

In 1889 Cayley showed that the number of labeled trees with n distinguishable 
vertices is n n ~ 2 . We begin giving an apparently new proof of this result. The article 
of Moon ([7]) lists ten different proofs. Renyi ([HI]) gave another proof of this fact. 
As noticed in the beginning of the proof by Clarke ( [3] ) , all trees labeled with n + 1 
points can be represented as rooted trees where an arbitrary chosen vertex is fixed 
as the root. Counting these trees by dividing the remaining n vertices into r subsets 
Vi,...,V r of sizes ki,...,k r and letting Vi denote the vertices at distance I from the root 
(in the path lengths metric), one has kfi_ x choices to connect to the set V/_i. Given 
the Cayley result we thus have a proof of the following Theorem 12.11 Conversely, we 
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shall prove Theorem 12.11 by simple induction, which leads to a new proof of Cayley's 
Theorem as an obvious corollary 

Theorem 2.1. Let nGN, the natural numbers. Then 

E E i ^^-e 1 = (» + ir 1 . 

r=l fei,...,ifc r eN:y_;[ =1 &i=n 



Proof. The binomial formula reads as 

n n-fc-l = _ fc + fc)n-*-l = ^ ^ ^ j^- 1(ri _ fc )n-> 

Now proceed by induction to show for s > 1 that 



r=l k\,...,k r >l]k\ + ...+k r =n 



+ E 



ri! 



fciL.fcJfn — Ah — ... — 

fci,...,fc a >l:fci+...+fc s <n v 7 

k s k\ % ...k k s s _i{n — k\ — ... - fc s _ 1 ) n - fcl - fca ---*'- 1 . 
Having established the basic formula we immediately derive the following corollary. 
Corollary 2.2. Letn>\. Then 



n-l 



E E roi* f, " 1 -"' # '~ 1 = ( " +1) 

Proof. As mentioned before the previous theorem every tree with n + 1 labeled 
vertices {t>o, can be represented as a rooted tree with (say) root vq. Consider 

a partition of {vi, ...,v n } into subsets Ei,...,E r of cardinalities ki,...,k r . The number 
of labeled trees with vertices from E\ is kf l ~ 2 according to Cayley's formula. There 
are ki choices for a root in E\. For each choice of a root in Ei and each tree in Ei, 
I = 1, r, we can construct a unique tree of all vertices by connecting the roots in E\ 
with vq. This has YYi=i choices. Summing over Ei,...,E r , then over 
with fci + ...k r = n, and and finally over r = 1, n shows the corollary. 

3. Abelian Distributions 

In 2002 Eurich et al. [1] proposed a probability which describes the sizes of 
avalanches in neural dynamics. The proportionality factor in this approach has been 
determined by Levina [6J in 2008. In addition she was able to determine the expec- 
tation of this distribution. 

Suppose we have N neurons, of which one is in its firing state. Then it gives 
a certain internal impulse to each other neuron (a complete network is assumed). 
There may be a certain number of inactive neurons which move to the firing state 
after receiving the internal input. They begin to fire sending the same impulse to all 
other neurons. Continuing this way one obtains an avalanche, and if it stops, denote 
by X the total number of firing neurons in an avalanche period. It was claimed in [1] 
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that the distribution of X has asymptotically (as the number of neurons N tends to 
oo and the internal impuls Np — > 1) the following form: 

Theorem 3.1. Let N be a positive integer and p G [0, jt). Then for k = 

1,2,..., N 



(3.1) Pk = PiX = k) = 1 _ [N _^ 1)p k"-^ k _ 1 )//-(. 1 -/,-,) 
defines a probability distribition with expectation 

(3.2) E[X] = ■ 



1 - (N - l)p' 

This distribution (13. ip was called Abelian distribution in [6] . The motivation of this 
formula is as follows. Suppose one neuron is excited in a complete neural network. 
Then A; — 1 is the number of neurons firing successively in the avalanche, each with 
probability p. Note that (1 — (kp) is the probability that a neuron is not firing during 
the avalanche period of avalanche size k. In fact, we would expect (and derive it 
below) that the exponent of the factor 1 — kp is N — k the number of non-firing 
neurons. 

There are two proofs of Theorem 13.11 one is given by Levina by showing that nu- 
merator and denominator are polynomials in p and then verifying the identity at 
a finite number of points. The second method is by using a generalized binomial 
theorem (personal communication by M. Rao to one of us). Below we will give a 
dynamical proof of a related formula using measure preserving dynamical systems. 
Besides we will show how such a law can be derived using Theorem 12.11 

Urn models 

Consider iV distinguishable balls and M enumerated urns 1,2, ...,M. Distribute 
the N balls randomly in the urns, so the probability of an elementary event is jp?. 

Let X be the largest integer r G {1, M} such that for each k < r the number of 
balls in urns 1, k is at least k. For example, X = if no balls is placed in urn 1, 
and X = 1 if one ball is placed into urn 1 and no ball in urn 2. In general, one has 
r balls in the urns numbered 1, ...,r and none in the r + 1st urn and the number of 
balls in urns 1, .., k is at least k for each k < r. We have 

Lemma 3.2. The distribution of X is given by the avalanche distribution: 

P({X = a}) = ( N ) (a + l)" -1 — ( 1 - ^±- lX ^ 
V1 IJ V a / Ma V M 

where a = 0, 1, 2, N. 

Proof. Partitioning {1,2, N} into sets J\, J r+1 of cardinalities k\, k 2 ,..-, &v+i 
N — a the number of elementary configurations for which X = a = k\ + ... + k r is 



t,k 2 uk 3 ik r 
At 1 hv 2 ...fty_l. 
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(Put the balls from J\ into urn 1, then the balls in J 2 in one of the boxes 2, h\ + 1 
etc.) If a is fixed, sum over all such partitions to arrive at 

P(x = a) = V V rAik1 2 -k k / ! H ^(1 - ^V' a . 

v ; ^ ^ k x \...k r \ 1 r Ha/M" M 1 

r=0 fei,...,fe 7 .>l;fc 1 +...fc r =a v 7 

Now apply Theorem 12.11 to obtain the formula in the lemma. 

Dynamical systems as a model 

For i = 1, N let 5*j : Xj — >■ Xj be continuous maps on the metric spaces Xj with 
metric d, t for % — 1, ...,X. Let X = Xx x X 2 x ... x X N denote the X-fold product 
space and S = S\ x 5*2 x ... x Sn the product map on X. 

We define the avalanche associated with open sets U C Xi (1 < i < N) which 
satisfy the condition that that they are the top level of towers of heights + 1 > N 
for the transformation Si. That is: there exist sets Bi C Xi such that the sets Sf(Bi) 
for k = 0, ...,rij are pairwise disjoint and S^^Bj) = Ui. An avalanche of (X, S) at 
the point x G X is defined by the set of coordinates which move under Sf (j > 0) 
through the sets Ui such that at each level rij — I of the tower there are at least Z 
coordinates which are above that level. A coordinate in a set Ui or moving through 
U during an avalanche period is called an excited coordinate (state). 

Formally the avalanche size is defined as follows. For x = (xi,X2, x^) G X define 

A(x,l) = \{1 < i < N : Xi G U}\ 

and 

A(x,2) = \{1 <i < N :30 <l < A(x,l) 3 S\{xi) G Ui}\. 
Then, recursively, define for k > 2 

A(x, k + 1) = |{1 < i < N : 30 < / < k) 3 S&Xi) G C/J|. 

Note that the sequence A(a;, /c) is increasing. 

Lemma 3.3. There exists a minimal k < N such that A(x, k + 1) = A(x, k). 

Proof. Since the iterates S\(Bi) of Bi are pairwise disjoint for / = 0, ...,N < rii the 
i-th coordinate can fall only at most once into U for iterations up to time N. 

Definition 3.4. The value A(x) = caidA(x, k) such that 

A(x, k) = A(x,k + 1) 
is called the avalanche size at i G X. 

Suppose we have a partition of {1,2, N} into r + 1 sets of sizes k 1 ,...,k r+1 , so 
k\ + k 2 + ... + k T+ i = N. We denote the sets of the partition by I\, ...,I r+ i. Such 
a partition corresponds to an avalanche of size a = k\ + ki + ... + k r : letting the 
coordinates (states) in 1\ be excited in the beginning, then the coordinates in I 2 until 
we let the coordinates in I r be excited; finally we denote by I r+ \ the coordinates 
which are never excited. 
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We describe this formally. Let 

ieh igh 

so for x G Ei the coordinates Xi of x for which ieh belong to the sets Ui = S ni (Bi), 
and are excited states. 

In the second step we have the particles in I 2 firing if x belongs to 

fci 

E 2 = ®(JS?-\B i )®®X i . 

ieh 1=1 i02 

Continuing this way we obtain sets 

Ei (g)U S" ' k '(!!;) (g)-V, 

ieh J=l i0l 

which describes the points for which the coordinates are firing in the 1-th step but 
not before (I = 2, r). 
Finally we put 

a 

E r+1 = (g) XAU^" 1 ^)® X " 

ielr+i 1=0 i£I r +i 

where a — k± + ... + k r is the total number of firing coordinates. The set E r+ i has 
only coordinates which are not at all firing. Also note that A(x) = a is the avalanche 
size. 

Now put E — Ei fl E 2 fl ... fl E r+1 and this set is where we have an avalanche of size 
a with exited states described by the sets h, i — 1, ...,r. 

We assume now that there exist Si-invariant ergodic measures TOj on Xi, 1 < i < N. 
Then the product measure 

m = ®f =1 rrii 

is S-invariant and ergodic. We have 

Lemma 3.5. Let h, I r+i be as above. Then 

r 

m(E) = J] rrn(Ui) J] J] fc,_im i (C/ i ) J] (!"(«+ 1 W^))- 
Corollary 3.6. /ei m^C/j) = p /or a// i = 1, AT. T/jen 

m(£0=p°(l-(a + l)p) JV -°n^ 1 . 
Theorem 3.7. Lei A : X — >■ N denote the avalanche size function. Define 

r 

K r (a) = {(h, k 2 , k r+ i) : h, k r > I, k r+1 = N - a; ^ k t = a}. 

i=l 
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Then for any a = 0, 1, 2, N 

m({x G X : A(x) = a}) 



e e e n^^nn^-^^ 

r=l (fc 1 ,fc a ,...,A! r +i)eifr(o) fl,.-,'r+l ieli «=2 ie/j 

11 (l-(a+lK(t/i)), 



where 7 denotes summation over all partitions of {I, N} into sets I\, ...,I r+ i 

of sizes fci, fc r +i- 

In particular, if rrii{Ui) = p for all % = 1, iV t/ien 



m({a; G X : A(ac) = a}) = (a + l)*" 1 (^)p a (l - (a + 



JV-a 



Proof. Note that the first formula is immediate from the foregoing discussion. More- 
over, if all rrii(Ui) = p for some p G [0, 1] then, by Theorem 12. 1[ the formula reduces 
to 

m({x G X : A(x) = a}) 
a /VI r 

- E E w^n(^>*(i-( a+ i) P r» 

r=l /ci+fc 2 + ...+fcr=a;fcr+l=A r -a «=2 

- E E irran(*-) l '(a>° (1 - (a+1)rt ""° 

r=l fci+fc 2 +...+fcr=a Z=2 v 7 

= (a+l) a - 1 ( N )p a (l-(a + l)p) N - a . 



a 



Corollary: Let p = a/N. Then for each a 

.. .. . m({A = a}) 3 ,1, 
hm lim log — -— r- = ho - 

q^itv^oo m({A = a+l} 2a a' 

Proof. The proof uses Taylor expansion of the logarithm: 

hm lim log — ttz r- = 1 + a log 

a^iN^oo m({A = a + l} a + 2 



a + 2 2(a + I) 

+ o(l/a) 



a + 2 2(a + 2) 2 

Remark 3.8. Note that this asymptotic means that 

ra(sc G X : A(x) = a) ~ a" 3/2 . 

Remark 3.9. The distribution has only local maxima for a close to 1, i.e. in the 
supercritical case. 
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Remark 3.10. It is straight forward to deduce a Levina type result from Theorem 13. 71 
Since in neural networks it is assumed that one neuron starts to fire, we are looking at 
the conditional distribution that one particular neuron is firing. Conditioned on this 
event, there are N — 1 neurons remaining which may form an avalange of possible sizes 
1, N including the initial firing neuron. According to Theorem 13. 71 the distribution 
is given by 

P(A = a) = a a ~ 2 ~^jp a '\l ~ ap) N ~ a , 

where a = 1,...,N. This is almost Levina's formula; the power in the last factor 
differs. 

We can get the expectation of the Abelian distribution in Theorem 13.11 from our 
theorem. 

Corollary 3.11. We have 

N 



1-Np 



\-{N-l)p^ \k-lj^ v l-(N-l)p 

Remark 3.12. The corollary means that the avalanche size in Theorem 13.11 has 
expectation 1 _^_ 1 ^ p (see (13.21) ). 



Proof. For each x £ [0, -^) we know from Theorem 13.71 that 
f( x ) = J2(a + ir- 1 ( N )x a (l-(a + l) 



x) N - 



a=0 

Taking derivative with respect to x yields 

f{x) = (N + l) N - 1 Nx N - 1 - Nil-x)*- 1 



a - U ]x a -\l - (a + l)x) N - a -\a(l-Nx)-Nx) = 0. 



a=l x ' 



Since N = N ^_ ( ^ff 1 ^ x we obtain 



f'(x) = J2(a + l) 11 ' 1 ( N \ x a -\l - (a + l)x) N - a -\a{l - Nx) - Nx) = 0. 

a=0 V a / 

Multiplying by x and replacing a by b — 1 yields 

N+l , AT v 

(3.3) f'(x) = Ys bb ~{ tli )x b ~ 1 (l-bx) N+1 - b - 1 ((b-l)(l-Nx)-Nx) = 0. 
By Theorem 13.11 we get 

6=1 v 7 



N-b _ i 
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Thus, it follows from (13 .3D that 
l-Nx i 



E hb ~ l ( _ i ) a;6_1 ( 1 " bx) N ~ b (l - iVx) 

6=1 ^ ' 

N+1 ( N \ 



1 — (N — l)x 



1 - Nx 



1 — (N — 



I. 
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